Robust Real-time 3D Detection of Obstructed Head and Hands in Indoors Environments

نویسندگان

  • Sébastien Grange
  • Charles Baur
چکیده

We address the need for robust detection of obstructed human features in complex environments, with a focus on intelligent surgical UIs. In our setup, real-time detection is used to find features without the help of local (spatial or temporal) information. Such a detector is used to validate, correct or reject the output of the visual feature tracking, which is locally more robust, but drifts over time. In Operating Rooms (OR), surgeons’ faces and hands are typically obstructed by sterile clothing and tools, making statistical and/or feature-based feature detection approaches ineffective. We propose a new method for head and hands detection that relies on geometric information from disparity maps, locally refined by color processing. We have applied our method to a surgical mock-up scene, as well as to images gathered during real surgery. Running in a realtime, continuous detection loop, our detector successfully found more than 97% of target features, with very few false positives (less than 0.7%).

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Robust 3D Hand Detection for Gestures Recognition

The aim of this paper is to present a fast, robust and adaptive method for real-time 3D hand detection. Unlike traditional 2D approaches which are based on skin or features detection, the proposed method relies on depth information obtained from a stereoscopic video system. As a result, it provides the 3D position of both hands. It also deals with changes of lighting and it is capable of detect...

متن کامل

3D Modeling of Building Indoor Spaces and Closed Doors from Imagery and Point Clouds

3D models of indoor environments are increasingly gaining importance due to the wide range of applications to which they can be subjected: from redesign and visualization to monitoring and simulation. These models usually exist only for newly constructed buildings; therefore, the development of automatic approaches for reconstructing 3D indoors from imagery and/or point clouds can make the proc...

متن کامل

Bilateral teleoperation control to improve transparency in stiff environment with time delay

This paper proposes a new bilateral control scheme to ensure both transparency and robust stability under unknown constant time delay in stiff environment. Furthermore, this method guaranties suitable performance and robust stability when transition occurs between soft and stiff environments. This framework is composed of an adaptive sliding mode controller and an adaptive impedance controller,...

متن کامل

Stereo-Based Head Pose Tracking Using Iterative Closest Point and Normal Flow Constraint

In this text, we present two stereo-based head tracking techniques along with a fast 3D model acquisition system. The first tracking technique is a robust implementation of stereo-based head tracking designed for interactive environments with uncontrolled lighting. We integrate fast face detection and drift reduction algorithms with a gradient-based stereo rigid motion tracking technique. Our s...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Journal of Multimedia

دوره 1  شماره 

صفحات  -

تاریخ انتشار 2006